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ABSTRACT 

The  optimal  (adaptive)  linear  combiner  (beamformer)  weights 
for  a  sensor  array  are  expressed  in  terms  of  the  inverse  of  the 
multi-channel  (MC)  covariance  matrix.  Rather  than  form  an 
estimate  of  the  covariance  matrix  directly  from  the  available 
data  and  inverting  it,  an  alternative  direct  estimate  of  the  in¬ 
verse  may  be  obtained  by  forming  parametric  MC  linear  pre¬ 
diction  estimates  and  then  expressing  the  inverse  in  terms  of 
these  parametric  MC  estimates.  The  resulting  parametric  es¬ 
timate  of  the  inverse  is  typically  more  accurate  than  inverting 
the  estimate  of  the  covariance  matrix.  This  paper  reveals,  for 
the  first  time,  the  structure  of  the  the  inverse  of  the  covariance 
matrix  for  the  MC  version  of  the  covariance  least  squares  lin¬ 
ear  prediction  algorithm.  The  inverse  structure  involves  prod¬ 
ucts  of  triangular  block  MC  Toeplitz  matrices,  which  leads  to 
fast  computational  solutions  for  the  optimal  weights. 

Index  Terms —  Adaptive  Arrays,  Matrix  Decomposition, 
Matrix  Inversion,  Radar  Signal  Processing,  Multichannel 

1.  INTRODUCTION 

The  output  y  =  wTx  of  a  linear  combiner  (space-time  filter) 
operating  on  an  arbitrary  geometry  sensor  array  is  expressed 
in  terms  of  an  inner  product  of  a  multi-channel  (MC)  weight 
vector  w  of  dimension  M  x  1  and  a  comparable  dimension 
MC  data  vector  from  the  array.  For  a  stationary  array  (posi¬ 
tion  does  not  change  with  time),  the  MC  data  vector  is  a  func¬ 
tion  of  just  spatial  dimension  M.  For  a  non- stationary  array 
(position  changes  with  time),  the  MC  data  vector  is  a  func¬ 
tion  of  both  spatial  dimension  M  and  temporal  dimension  N. 
An  example  that  motivates  this  paper  is  the  radar  space-time 
adaptive  processing  (STAP)  problem,  as  summarized  in  [1], 
It  is  well  known  that  the  optimal  (adaptive)  weights  that  min¬ 
imize  the  variance  of  the  output  y  while  passing  a  signal  from 
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a  preferred  steering  vector  direction  represented  by  the  vector 
e  is 

w  =  R~1e  (1) 

for  which  the  MC  covariance  matrix  R  is  typically  estimated 
as 

R=^X>[r]x>]  (2) 

r—1 

over  R  measured  realizations  of  the  MC  data  vector  x.  How¬ 
ever,  we  have  found  that  improved  estimates  of  the  inverse 
MC  covariance  matrix  may  be  obtained  using  MC  parametric 
estimation  algorithms  because  the  inverse  covariance  matrix 
can  be  expressed  directly  in  terms  of  the  estimated  MC  para¬ 
meters.  This  paper  summarizes  the  relationship  of  the  inverse 
to  the  MC  parameters.  Details  of  the  actual  performance  of 
the  adaptive  array  using  the  MC  parametric  approach  will  be 
found  in  companion  papers  presented  at  the  Asilomar  2006 
and  DASP  2006  conferences.  For  reference,  we  first  illustrate 
the  inversion  formula  in  terms  of  the  MC  parameters  in  the 
known  covariance  case,  and  show  that  the  inverse  can  be  ex¬ 
pressed  in  terms  of  products  of  block  triangular  Toeplitz  struc¬ 
tures.  Next,  we  reveal  for  the  first  time  the  inverse  obtained 
from  MC  data  using  the  MC  covariance  method  of  linear  pre¬ 
diction.  Surprisingly,  the  structure  of  the  inverse  can  still  be 
expressed  in  terms  of  products  of  block  triangular  Toeplitz 
structures,  which  leads  to  fast  computational  solutions  for  the 
optimal  weight  vectors  (covered  in  the  other  conference  pa¬ 
pers). 

2.  MULTI-CHANNEL  LINEAR  PREDICTION 
PARAMETRIC  MODEL  AND  INVERSE  FOR  KNOWN 
COVARIANCE 

The  MC  forward  linear  prediction  error  (LPE)  of  model  order 
p  for  the  MC  signal  x[n;  r]  of  M  channels  at  each  realization 
r  is  defined  as 

p 

e“ [n;  r]  =  x[n;  r }  +  ^  A p[k]x\n  -  k\  r\  (3) 
fc= l 
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with  dimension  M  x  1,  in  which  Ap[fc]  are  the  MC  forward 
linear  prediction  parameter  matrices  of  dimension  M  x  M. 
This  may  be  expressed  in  vector  inner  product  form  as 


The  choices  for  the  forward  and  backward  LP  parameters  ap 
and  b;)  that  minimize  the  variances  P“  and  Pp  can  be  shown 
[3]  to  satisfy  the  pair  of  MC  Yule- Walker  normal  equations 


>;r]  =  (I  a p)xp[n;r] 


(4) 


for  which  ap  =  (Ap[lj . . .  Ap \jj] )  is  a  M  x  Mp  block  row 
vector  of  the  MC  forward  LP  parameters  and 


x \n:  r\  = 


/  Xi  [n;  r] 

) 

f  x[n;  r]  \ 

,  r]  =  1 

1 

'  — p  L  ’  J  1 

\  xM[n;r] 

J 

\  x[n  -  p:  r\  / 

(5) 

are  M  x  1  and  M(p  +  1)  x  1  column  vectors,  respectively,  of 
data  samples.  Similarly,  the  MC  backward  linear  prediction 
error  (LPE)  is  defined  as 


ep[n;  r]  =  x[n  —  p\  r]  +  ^  Bp[/c]x[n  -  p  +  k\  r] 


k= 1 


(6) 


=  (bp  I)xp[n;r] 


for  which  bp  =  (Bp[p] . . .  Bp[l])  is  a  1  x  p  block  row  vector 
(scalar  dimension:  M  x  Mp)  of  the  MC  backward  LP  parame¬ 
ters  (note  that  the  backward  LP  parameter  vector  has  reversed 
time  indexing  relative  to  the  forward  LP  parameter  vector). 
The  M  x  M  MC  forward  LPE  variance  is  both  defined  and 
expressed  as 

Pp  =  £  {e>](e>])“}  =  (I  ap)  Rp  (  )  (7) 

in  which  Rp  is  the  M  x  M  MC  block  Toeplitz  autocovariance 
matrix  [it  is  also  hermitian  symmetric  with  a  scalar  dimension 
of  M  (p  +1)  x  M(p  +  1)  ] 


Pp  = 


/  R[0] 

R*  [1] 


V  R*[p] 


R[i] 

•  R[p-i] 

R  [p] 

R[0]  •  ■ 

•  R  \p-  2] 

R[p  - 1] 

R*[p-2] 

R[o] 

R[i] 

R*b- 1] 

R*  [1] 

R[o] 

(8) 


composed  of  the  stationary  M  x  M  scalar-dimensioned  MC 
autocovariance  matrix  elements 


Rfml  = 


rn[m] 


r mi  m 


riM[m]  \ 

TMM[m]  / 


(9) 


in  which  rjk[m]  is  the  scalar  cross-covariance  between  chan¬ 
nels  j  and  k  at  time  lag  index  m.  In  a  similar  manner,  the 
M  x  M  MC  backward  LPE  variance  is  given  by 


Pbp  =  £{ebp[n](ebp[n])H}  =  (bp  I)  Rp 


bp 

I 


•  (10) 


(I  ap)  Rp  =  (P“  0p)  (11) 

(bp  l)  Rp  =  (Op  Pp)  (12) 

in  which  0p  is  a  M  x  Mp- array  of  all-zeros.  Define  the  M  x 
M  MC  partial  correlation  coefficient 

Ap  =  £  {ep-iM (ep-i[tt  -  1])"}  (13) 

and  the  M  x  M  MC  lattice  filter  parameters  Fp  =  Ap  [p] 
and  r(  =  Bp[p];  note  that  A P[p\  /  Bp[p],  in  contrast  to  the 
one-dimensional  case  where  they  were  identical.  The  fast  MC 
Levinson  algorithm  [3]  can  solve  the  M(p  +1)  x  M(p+  1) 
Eqs.  11  and  12  in  a  number  of  computational  steps  propor¬ 
tional  to  {Mp)2,  rather  than  proportional  to  the  usual  ( Mp )3, 
while  avoiding  the  explicit  formation  of  the  block  matrix  Rp . 
Assuming  the  initialization  Pq  =  Pq  =  R[0],  the  four  steps 
of  the  MC  Levinson-like  recursion,  that  solves  for  the  MC  LP 
parameters  ak  and  bfc  and  the  MC  LPE  variances  Pf.  and  Pp 
over  orders  k  =  1 , . . . ,  p,  are 


/  R  [k]  \ 

Ak  =  ^k-i) 

V  R[1]  / 

Pfc  =  ~Ak  (Pfc-t)"1 
r^  =  -Af  (p^— i) — 1 
(I  afc)  =  (I  ak_i  0)  +  (0  bfc-1  I) 

(I  bfc)  =  (0  bk_x  I)  +  (I  a*.!  0) 

^ k  ~  ~  1  fc1  k)  1 

T>b  _  (-r  _  -p6-pa\  pb 

~  1  fc1  k)  rk-l 


(14) 

(15) 

(16) 

(17) 

(18) 

(19) 

(20) 


This  algorithm  reduces  to  1-D  Levinson  recursion  when  M  = 
1  (one  channel). 

The  preferred  form  of  the  block  Toeplitz  inverse  [3]  [2] 
which  is  useful  to  this  project,  and  which  also  depends  only 
on  the  last  parameter  order  computed,  is 


R 


-l 

p 


A  Hp“  A  —  BHP°B 

— p  — p—  p  — p  — p— p 


(21) 


in  which  the  block  triangular  Toeplitz  matrices  are  given  as 


/  I  Ap[l] 

A P[p\  ^ 

0 

V  °  ••• 

Ap[l] 

0  I  ) 

(22) 
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BP  = 


pa  _ 

P 


P6 

— V 


(  0  bp\p\ 

o 

v  o  ... 


(  (Pp)"1  0 


V  o 

l  (P^)-1  0 

0 


V  0 


■  •  •  Bp[l]  \ 

B  P\p] 

0  0  ) 

0  \ 


o  (Pp-1  ) 
...  0  \ 


o  (Pp-1  ) 


(23) 


(24) 


(25) 


3.  MULTI-CHANNEL  COVARIANCE  LEAST 
SQUARES  LINEAR  PREDICTION  PARAMETRIC 
MODEL  AND  INVERSE 


A  full  least  squares  minimization  against  all  the  MC  linear 
prediction  parameter  matrices  ap  and  b,  simultaneously  is 
the  basis  of  the  MC  covariance  method  of  least  squares  linear 
prediction.  To  set  up  the  problem  for  a  least  squares  solution, 
the  MC  forward  LPE  and  MC  backward  LPE  of  order  p  can 
be  expressed  as  M  x  (TV  —p)R  block  row  vectors  when  there 
are  a  finite  number  of  N  samples  and  R  realizations  for  M 
channels 

e“  =  (e>  +  1;  1] . . .  e“[7V;  R})  =  (I  ap)  Xp  (26) 

e£  =  (ep[V;  1] . . .  ep[p  +  1;  f?])  =  (bp  I)  Xp  (27) 

in  which  the  M  (p  + 1 )  x  (N  —  p)  R  block  rectangular  Toeplitz 
data  matrix  Xp  and  M  x  R  block  data  vector  X[fc]  are  defined 
as 

/X[p+ 1]  •••  X[N  —  p]  •••  X[N)  \ 

-p  = 

V  X[l]  •••  X[p+1]  ...  X[N-p]J 

(28) 

X[fc]  =  (  x[fc;  1]  •••  x[fc;  R]  )  (29) 

The  magnitude  squared  error  sums  [or  variance  estimates,  if 
divided  by  ( N  —  p)R]  can  then  be  expressed  as 

P“  =  e£(e“)*  (30) 

P  p  =  (3D 

Minimizing  the  trace  of  each  of  these  estimated  variances  [3] 
then  leads  to  the  following  (p+ 1) -block-dimensioned  normal 
equations 


In  general,  the  MC  forward  and  backward  LP  parameters  in 
the  least  squares  case  are  not  complex  conjugates  of  the  other, 
unlike  the  situation  in  the  one-channel  known  autocovariance 
case.  Comparing  Eqs.  32  and  33  to  the  recursions  in  the 
known  covariance  case  of  the  previous  section,  one  can  see 
that  the  block  non-Toeplitz  (p  +  1)  x  (p  +  1)  least-squares- 
based  product  matrix  XpXp  has  replaced  the  role  of  the  block 
Toeplitz  (pTl)x(pTl)  autocovariance  matrix  Rp.  When 
the  MC  covariance  least  squares  linear  prediction  algorithm 
is  used,  the  inverse  (XpXp  )  will  be  used  in  lieu  of  R”1 
in  all  the  detection  statistics  discussed  in  [5].  Despite  the  fact 
that  least-squares  normal  Eqs.  32  and  33  do  not  have  a  block 
Toeplitz  matrix,  the  non-Toeplitz  XpXp  matrix  is  the  product 
of  two  rectangular-shaped  block  Toeplitz  data  matrices  Xp 
and  Xp.  This  is  sufficient  to  generate  an  order-recursive  fast 
computational  algorithm  that  requires  a  number  of  compu¬ 
tational  operations  proportional  to  p2,  rather  than  the  usual 
solution  proportional  to  p 3,  to  solve  simultaneously  for  both 
forward  ap  and  backward  bp  MC  LP  parameters.  The  MC 
least-squares-based  fast  algorithm  requires  the  introduction  of 
two  additional  gain  adjustment  vectors,  defined  as 

cp  (XPXP  )  =  x£  [N]  =  (x-  [N]...  x"  [N  -  p})  (34) 

dp  (XpXp')  =  xp  [p  +  1]  =  (xH[p  +  1] . . . xH[l])  (35) 

in  which  the  Rx  (p+l)M  gain  vectors  are  cp  =  (cp[0] . . .  cp  [p]) 
and  dp  =  (dp  [0] . . .  dp[p]).  We  will  also  need  to  define  the 
M  x  M  gain  vector  variances 

Pcp  =  I  -  xp[p  +  1]  (XPX«  )  _1  x>  +  1]  (36) 

Pp  =  I  —  *p[N]  (XPX^ )  x«[7V]  .  (37) 

Note  that  trace  tr{Pp}  >  0  and  trace  tr{Pp}  >  0.  The  key 
MC  Levinson-like  order-update  recursions  in  the  MC  covari¬ 
ance  least  squares  linear  prediction  case  are 

(I  ap)  =  (I  ap_x  0p)  +  r»  (op  gif  i)  (38) 

(I  bp)  =  (Op  gif  i)  +  Tp  (I  ap_!  0P)  (39) 

and  the  time-adjusted  LP  parameter  g^adj  time-update  re¬ 
cursion  has  the  form 

g-adj'  =  bp  +  C,  cp_!  +  C2dp_1  (40) 

for  unspecified  M  x  M  matrix  constants  C\  and  C^.  Similar 
order  and  time  updates  for  cp,  dp,  ep[n],  and  ep[n]  are  a  part 
of  the  fast  MC  algorithm,  but  not  shown  here. 

The  inverse  matrix  ( XpXp )  can  be  explicitly  expressed 

as 


(I  ap) 

(XpXf  = 

(Pp 

ot 

(32) 

(XpXf  =  ApPpAp  —  BpPpBp 

(bp  I) 

(XpXf  = 

(Qp 

pf) 

(33) 

+  Cp_1P^Cf1-Dp_1P^Df1 

II-  1139 


in  which  the  block  triangular  Toeplitz  matrices  are 


Ap  = 

r  1  0 

Ap[l]  I 


0  0  'j 

0  0 


Ap[p-1]  Ap[p-2]  I  0 

Ap[p]  Ap\p-1]  ■■■  Ap[l]  I  , 


are  formed  from  the  forward  linear  prediction  parameters  Ap  [to] , 
forward  linear  prediction  squared  error  variance  P“,  back¬ 
ward  linear  prediction  parameters  Bp[m],  backward  linear 
prediction  squared  error  variance  matrix  P£,  gain  adjustment 
block  vector  parameters  cp[m]  and  dp[m],  and  matrix  gain 
adjustment  variances  P£  and  P^.  These  are  defined  as  ma- 
(42)  trix  equations  associated  with  the  covariance  linear  prediction 
case.  The  structures  of  Pp,  P£,  and  Pp  are  similar  to  that 
shown  for  P“. 


'  0  0  •••  0  0 

Bp[p]  0  •  •  •  0  0 


Bp  [2]  Bp  [3]  0  0 

l  Bp[l]  Bp [2]  •••  Bp[p]  0 


(43) 


C 


p- 1 


0  0 

cp-r[0]  0 


0  0  J 

0  0 


cp_i[p-2]  Cp_i[p  —  3]  0  0 

l  cp— i [p  1]  Cp_i[p  —  2]  •••  Cp_i[0]  0  , 


(44) 


— p-i  — 


0 

dp- 1  [0] 


0 

0 


0  0  ' 

0  0 


dp-t[P  —  2]  dp_  i  [p  —  3] 

l  dp_ i[p  —  1]  dp_i[p-2] 


0  0 

dp— i  [0]  0  J 

(45) 
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